Display device and image display system

ABSTRACT

A display device and an image display system are provided which can easily identify different kinds of windows. Solution: A list X of simplified images M is based on data containing associated information of multiple attributes as metadata. A display is provided to display the list X in a matrix in which the simplified images M are located for respective pieces of associated information of one attribute in a row direction while the simplified images M are located for respective pieces of associated information of another attribute in a column direction. The display has a first sub window SW 1  and a second sub window SW 2  that are displayed in different display modes on the list X, the first sub window SW 1  containing the images M sharing the associated information of one attribute and the associated information of another attribute in the list X of the images M, the second sub window SW 2  containing the images M placed in the same folder in the list X of the images M.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of, and claims priority to each of,U.S. patent application Ser. No. 14/764,496, filed on Jul. 29, 2015,entitled DISPLAY DEVICE AND IMAGE DISPLAY SYSTEM, which is a nationalstage application under 35 U.S.C. § 371(c) of PCT application serialnumber PCT/US2014/012991, filed on Jan. 24, 2014, entitled DISPLAYDEVICE AND IMAGE DISPLAY SYSTEM, which claims priority to JapanesePatent Application Serial No. 2013-014405, filed on Jan. 29, 2013,entitled DISPLAY DEVICE AND IMAGE DISPLAY SYSTEM. The above-listedapplications are herein incorporated by reference.

TECHNICAL FIELD

The present invention relates to a display device that displays a listof images based on data containing associated information on multipleattributes as metadata, and an image display system.

BACKGROUND

Japanese Patent Application Number 2010-182018 describes, for example, adisplay device connected to a server via a network to display imagesbased on medical data stored in the server.

The medical data stored in the server is, for example, medical imagedata including X-ray CT images obtained by an X-ray CT (ComputedTomography) scanner and MRI images obtained by an MRI (MagneticResonance Imaging) machine. Additionally, the medical data includes dataobtained by scanning paper documents, e.g., medical informationdocuments used in hospitals.

SUMMARY OF THE INVENTION

In some cases, quite a number of medical images and documents areprepared for hospital patients and are stored as data. An operator whomakes a diagnosis of a patient needs to find associated medical imagesand documents depending on the purpose of use. The operator may need tokeep a history of creation of medical data on a patient. Thus, thepresent inventor has proposed a display device that displays a list ofmedical images and documents in a matrix in response to these needs.

The list will be specifically described below. The uppermost row and theleftmost column of the list are the display fields of associatedinformation. Furthermore, a cell specified by the associated informationdisplayed on the two display fields of the associated informationcontains a corresponding image. For example, thumbnails of medicalimages and documents on the same date are displayed in a row direction(horizontal direction) while thumbnails of the same document type aredisplayed in a column direction (vertical direction).

For example, in the case of thumbnails of the same document type (thesame associated information) on the same date, all the thumbnails cannotbe fully listed. Hence, the present inventor has examined a windowdisplaying all the thumbnails of the cells on the list while each of thecells displays only one representative thumbnail. In addition to thewindow containing thumbnails of common associated information, thepresent inventor has examined a window displaying thumbnails of commoninformation other than the associated information on the list. Thus,more thumbnails can be displayed on the window in addition to the listwithout switching screens on the displayed list.

However, the display of windows of different types is confusing to anoperator.

An aspect of the invention devised to solve the problem has a list ofsimplified images based on data containing associated information ofmultiple attributes as metadata. A display is provided to display thelist in a matrix in which the simplified images are located forrespective pieces of associated information of one attribute in a rowdirection while the simplified images are located for respective piecesof associated information of another attribute in a column direction.The display has a first window and a second window that are displayed indifferent display modes on the list, the first window containing theimages sharing the associated information of one attribute and theassociated information of another attribute in the list of the images,the second window containing the images associated from a differentpoint of view from the metadata in the list of images.

The invention according to the aspect displays the first window and thesecond window in different display modes, thereby easily distinguishingbetween the first window and the second window.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an image display system accordingto an embodiment.

FIG. 2 shows the display screen of a display indicating a list.

FIG. 3 is a flowchart for explaining storage of a simplified image intoa folder.

FIG. 4 is a flowchart specifically showing processing in step SI of FIG.3.

FIG. 5 shows the display screen with a clicked first operation button.

FIG. 6 shows the display screen with a displayed folder browser window.

FIG. 7 shows an example of a table.

FIG. 8 shows the display screen with the folder browser window displayedwith a new “June” folder.

FIG. 9 shows the table with the added “June” folder.

FIG. 10 shows the display screen with a displayed second sub window.

FIG. 11 shows the display screen with a displayed first sub window.

FIG. 12 is an explanatory drawing of an operation for placing simplifiedimages for a conference in June into the “June” folder.

FIG. 13 shows the table including UIDs in the UID fields of the “June”folder.

FIG. 14 is an explanatory drawing of a movement of the list.

FIG. 15 shows the display screen on which the first sub window and thesecond sub window are hidden.

FIG. 16 shows the display screen on which folder icons are displayed onsimplified images M newly placed in the folder.

FIG. 17 shows the display screen with a cursor placed on the folder iconin the simplified image newly placed in the folder.

FIG. 18 shows the display screen with another second sub window.

FIG. 19 shows the display screen that displays the first sub windowcontaining the simplified images of CT images on May 18, 2012.

FIG. 20 shows the display screen that displays the first sub windowcontaining the simplified images M of a CT report on May 18, 2012instead of the simplified images of CT images on May 18, 2012.

FIG. 21 shows a folder viewer.

FIG. 22 is a block diagram showing another example of the image displaysystem according to the embodiment.

DETAILED DESCRIPTION

An embodiment of the present invention will be specifically describedbelow with reference to the accompanying drawings. An image displaysystem 1 in FIG. 1 includes a server 2 and a display terminal 3 that areconnected to each other via a network N. The image display system 1 is asystem for displaying images related to medical. The server 2 isconnected to multiple department systems 4 via the network N. The imagedisplay system 1 is an exemplary embodiment of the image display systemaccording to the present invention. The display terminal 3 is anexemplary embodiment of a display device according to the presentinvention.

The server 2 includes a storage 21, a display data creating unit 22, anda data output unit 23. The storage 21 is, for example, an HDD (Hard DiskDrive). The storage 21 stores, for example, medical data inputted to theserver 2 from the department systems 4 through the network N. The server2 is an exemplary embodiment of a server according to the presentinvention. The storage 21 is an exemplary embodiment of a storageaccording to the present invention.

The medical data stored in the storage 21 is data on a patient createdin medical facilities or examination facilities for conductinglaboratory tests. The medical data includes medical image data, documentdata, and numeric data. The medical data is an exemplary embodiment ofdata according to the present invention.

The medical image data is obtained by, for example, the modalities ofthe department systems 4. The medical image data includes, for example,X-ray CT images, MRI images, and ultrasound images. The document dataincludes, for example, medical image interpretation reports, medicalinformation documents, consent forms such as a surgical consent form andan examination consent form, interview sheets, application forms, andexamination results. Document data includes PDF (Portable DocumentFormat) data created by scanning paper documents. The numeric data isdata on numerical values pertaining to patients and indicates, forexample, examination results.

The medical data includes a log of patient's biological information suchas electrocardiograms and data on other patient's records as well as themedical image data, the document data, and the numeric data.

The medical data includes metadata as well as a data body. The metadataincludes associated information on multiple attributes, e.g., apatient's name, a patient's ID, a date, a document type, a documentcategory, and a hospital department. In this case, “associatedinformation” specifically means a name, a date, a document type, adocument category, and a hospital department while the attributesindicate the attributes of the associated information. For example,associated information with an attribute “document type” includes “CT”and “MRI” and associated information with an attribute “hospitaldepartment” includes “radiology” and “cardiology”. Metadata is a conceptcontaining attribute information (e.g., information on “document type”)and specific attribute information (i.e., associated information such as“CT”).

The metadata further includes a Unique ID (hereinafter, will be called“UID”) that is information for identifying medical data.

For example, the metadata includes data automatically provided by thedepartment systems 4, for example, modalities such as an X-ray CTscanner and manually inputted data.

A date in the metadata is, for example, the creation date of medicaldata. The date in the metadata may include a year and a time as well asa day. In the case of medical image data, the creation date may be adate of imaging. In the case of document data, the creation date may bea date of document creation.

A document type in the metadata is information on a medical data type.The information indicates types of medical images of MRI (MagneticResonance Imaging) and US (Ultrasound) and document types such as ahospitalization consent form, a hospitalization application, ahospitalization interview sheet, an examination consent form, and asurgical consent form. A document category in the meta data isinformation indicating a leading concept of a document type, forexample, a consent form.

A hospital department in the metadata is information indicating adepartment having requested creation of medical data, for example,radiology and cardiology.

An attribute in the metadata may be determined beforehand. In this case,the attribute may be deleted or an attribute may be added.

The storage 21 stores a table TA that associates a folder name with theUID of medical data on a simplified image M contained in a folder, aswill be described later.

The display data creating unit 22 creates data on images displayed onthe display terminal 3. For example, the display data creating unit 22creates data on a list X of simplified images M for the same patientbased on medical data stored in the storage 21. The list X is displayedon the display terminal 3 as will be described later (for example, seeFIG. 2). The display data creating unit 22 is an exemplary embodiment ofa list creating unit in the present invention.

Furthermore, the display data creating unit 22 creates data for a folderviewer FV displayed on the display terminal 3 (for example, see FIG. 6).The folder viewer FV will be discussed later.

Moreover, the display data creating unit 22 creates data for a first subwindow SW1 and a second sub window SW2 that are displayed on the list X(for example, see FIG. 11). The creation of data will be specificallydescribed later.

The data output unit 23 outputs data from the server 2 to the displayterminal 3 in response to a request from the display terminal 3.

In FIG. 1, the display data creating unit 22 and the data output unit 23are provided in the same server as the storage 21 that stores themedical data. The display data creating unit 22 and the data output unit23 may be provided in a server different from that of the storage 21.

The display terminal 3 is, for example, a general-purpose personalcomputer. Alternatively, the display terminal 3 may be a tabletcomputer. The display terminal 3 includes a display 31, a controller 32,an input unit 33, and a storage 34.

The display 31 is, for example, an LCD (Liquid Crystal Display) or a CRT(Cathode Ray Tube). The display 31 is an exemplary embodiment of adisplay in the present invention.

The controller 32 includes a data requesting unit 321, a displaycontroller 322, and a table creating unit 323. The data requesting unit321 outputs a signal for requesting data containing the list X to theserver 2, in response to an operator's input on the input unit 33.

The display controller 322 displays an image on a display screen 31 a ofthe display 31. For example, as shown in FIG. 2, the display controller322 displays the list X on the display screen 31 a of the display 31based on data in the list X inputted from the server 2. In FIG. 2, thedisplay 31 displays a part of the list X created by the display datacreating unit 22.

The list X contains associated information display columns C1 and C2 anda simplified image display column C3. The associated information displaycolumns C1 and C2 and the simplified image display column C3 are eachcomposed of multiple cells CE. The associated information display columnC1 includes the cells CE that are disposed in a row direction(horizontal direction) so as to constitute an uppermost row in the listX. The display column C2 for associated information includes the cellsCE that are disposed in a column direction (vertical direction) so as toconstitute a leftmost column in the list X.

The display controller 322 displays associated information of the sameattribute in the associated information display column C1. The displaycontroller 322 also displays associated information of the sameattribute in the associated information display column C2. Theassociated information display column C1 and the associated informationdisplay column C2 display the associated information of differentattributes. In FIG. 2, a document type is displayed in the associatedinformation display column C1 while a date (year, month, and day) isdisplayed in the associated information display column C2. Theassociated information displayed in the associated information displaycolumn C1 is an exemplary embodiment of associated information with anattribute in the present invention. The associated information displayedin the associated information display column C2 is an exemplaryembodiment of associated information with another attribute in thepresent invention.

The attributes of the associated information display columns C1 and C2may be changed by an operator's input with the input unit 33.

The simplified images M are displayed in the simplified image displaycolumn C3 based on medical data stored in the storage 21. The simplifiedimages M are, for example, thumbnail images. Data on the simplifiedimages M is created by the display data creating unit 22 of the server2. The simplified image M is an exemplary embodiment of an image basedon data in the present invention.

The creation of the image M by the display data creating unit 22 will bedescribed below. The display data creating unit 22 converts the medicalimage data to a proper display size in the list X. A list of images ofthis size (e.g., 64×64 pixels or 96×96 pixels) can be displayed on thedisplay screen 31 a.

In the case where medical data displayed as the simplified images M isnumeric data, the simplified images M created by the display datacreating unit may be images indicating the contents of the numeric data.For example, an image indicating the contents of numeric data includescharacters indicating the contents of the numeric data. The charactersindicating the contents of the numeric data show a type of examination.

The simplified image M displayed in the simplified image display columnC3 is clicked by an operator with the input unit 33, allowing thedisplay controller 322 to display an image (original image) based onoriginal medical data from which the clicked simplified image M has beencreated. The medical data is obtained from the server 2. Specifically,the data requesting unit 321 first requests the original medical data ofthe clicked simplified image M from the server 2. This request includesthe UID of the original medical data. In the server 2, the requestedmedical data is read from the storage 21 based on the UID inputted fromthe display terminal 3, and then is outputted to the display terminal 3by the data output unit 23.

The cells CE constituting the associated information display column C1display associated information in the vertical direction (columndirection) of the simplified image display column C3. The cells CEconstituting the associated information display column C2 displayassociated information in the horizontal direction (row direction) ofthe simplified image display column C3. The simplified images M arearranged in a matrix in the simplified image display columns C3. In thesimplified image display columns C3, the simplified images disposed inthe column direction have associated information displayed in the cellCE constituting the associated information display column C1 while thesimplified images M disposed in the row direction have associatedinformation displayed in the cell CE constituting the associatedinformation display column C2. In the simplified image display columnC3, the cell CE specified by the associated information of theassociated information display column C1 and the associated informationof the associated information display column C2 contains thecorresponding simplified image M.

Specifically, FIG. 2 displays the list X in which the simplified imagesM of respective document types are disposed in the column direction andthe simplified images M on respective dates are disposed in the rowdirection. For example, in the simplified image display column C3, asimplified image M (a thumbnail image indicating a CT image) based onmedical data having information indicating the CT image as associatedinformation is displayed by the display controller 322 in the column ofthe cells CE displayed as “CT”. Moreover, in the simplified imagedisplay column C3, a simplified image M based on medical data havingdate information of May 18, 2012 as associated information is displayedby the display controller 322 in the row of the cell CE displayed as“2012/5/18” in, for example, the associated information display columnsC2. Thus, the display controller 322 displays the list X in which thesimplified images M for associated information of an attribute aredisposed in the row direction and the simplified images M for associatedinformation of another attribute are disposed in the column direction.

If multiple pieces of medical data need to be displayed in one of thecells CE in the list X, that is, if multiple pieces of medical datashare two types of associated information displayed in the list X, thecell CE only displays representative one of the simplified images M. Forexample, in the case of multiple CT images on May 18, 2012, onlyrepresentative one of the simplified images M is displayed in the cellCE of the list X. The display data creating unit 22 may, however, createtwo or more simplified images M.

If the attributes of the associated information display columns C1 andC2 are changed, the display data creating unit 22 creates data on thelist X in which associated information of the changed attributes isdisplayed in the associated information display columns C1 and C2 andthe simplified images are relocated according to the changed attributes.

The list X can be scrolled by dragging with the input unit 33. If thedisplay 31 is a touch panel display, dragging or flicking with a fingerof an operator can scroll the list X.

The displayed list X allows the operator to recognize the history ofmedical data creation of a patient at a glance. As described above, thelist X satisfactorily shows medical data, allowing the operator toeasily recognize the frequency of hospital visiting of a patient.

The simplified images constituting the list X include simplified imagesM based on medical data stored in a folder by an operator's input withthe input unit 33, which will be specifically discussed later.

The table creating unit 323 creates a table TA for associating a foldername with a UID of medical data as will be described later.

The input unit 33 includes a keyboard and a mouse. The input unit 33 isan exemplary embodiment of an input unit in the present invention.

The storage 34 is, for example, a HDD or semiconductor memory such asRAM (Random Access Memory) and ROM (Read Only Memory).

The department system 4 is a hospital department system, for example, aradiology information system (RIS) including modalities such as an X-rayCT scanner and an MRI machine, and a laboratory test system.

The action of the image display system 1 of the present embodiment willbe described below. According to the image display system 1 of thepresent embodiment, the simplified images M constituting the list X of apatent can be categorized into folders by an operator. In this example,the simplified images M used for conferences in a hospital arecategorized into folders by an operator. The simplified images M areimages for a patient P.

Data on the simplified images M used for the conferences is placed intofolders by the operator from the simplified images M constituting thelist X. Specifically, the process will be discussed below with referenceto the flowchart of FIG. 3. First, in step SI, the operator displays thelist X on the display screen 31 a. Specific processing in step S1 willbe described below with reference to the flowchart of FIG. 4.

First, in step S11 of FIG. 4, the operator inputs an instruction fordisplay of the list X and specific information on the patient P, forexample, a name and an ID to the input unit 33 of the display terminal3. Subsequently, in step S12, the data requesting unit 321 requests dataon the list X of the patient P with the inputted specific informationfrom the server 2. This request includes the specific information of thepatient P.

In step S12, data on the list X is requested. In step S13, the displaydata creating unit 22 of the server 2 creates data on the list X.Specifically, the display data creating unit 22 first specifies all thepieces of medical data stored for the patient P in the storage 21 basedon the specific information on the patient P from the data requestingunit 321. The multiple pieces of medical data are created for thepatient P at different times. Furthermore, the display data creatingunit 22 creates data on the list X of the simplified images M for thepatient P, based on the medical data specified for the patient P.

Subsequently, in step S14, the data output unit 23 outputs, to thedisplay terminal 3, data on the list X created in step S13. In step SIS,the display controller 322 displays the list X on the display screen 31a based on the data on the list X inputted to the display terminal 3(see FIG. 2). The display controller 322 displays operation buttons OBwith the list X.

Subsequently, in step S2, the operator displays a folder browser windowFBW on the display 31 and creates folders, which will be specificallydescribed below. First, as shown in FIG. 5, the operator uses the inputunit 33 so as to click on a first operation button OBI of the operationbuttons OB with a cursor CD. As shown in FIG. 6, clicking on the firstoperation button OBI allows the display controller 322 to display thefolder browser window FBW on the display screen 31 a. FIG. 6 shows thefolder browser window FBW that displays a folder“conference-2012-February”.

The display of the folder browser window FBW will be discussed below. Aclick on the first operation button OBI first allows the data requestingunit 321 to request data of the folder browser window FBW from theserver 2. Subsequently, the display data creating unit 22 of the server2 creates data on the folder browser window FBW with reference to thetable TA stored in the storage 21. When the data on the folder browserwindow FBW is outputted to the display terminal 3 from the data outputunit 23, the display controller 322 displays the folder browser windowFBW based on the data.

The table TA will be discussed below. The table TA includes a“conference” folder that has a “2012” folder containing a “February”folder. In the present embodiment, these folders constitute ahierarchical structure. The “February” folder contains the simplifiedimages M used in conferences in February 2012. Thus, as shown in FIG. 7,the storage 21 stores the table TA that associates a folder name“conference-2012-February” with the UID of medical data stored in thefolder. The table TA in FIG. 7 has a UID field of Cum that indicates theUID of medical data of the simplified images M contained in the“February” folder (“x” marks in FIG. 7).

The table TA is not limited to a specific patient. Hence, the folder maycontain the simplified images of patients other than the patient P.

When the folder browser window FBW is displayed, the operator uses theinput unit 33 so as to click a “create new folder” button B1 with thecursor CU (not shown in FIG. 6), thereby creating a new folder. In thiscase, simplified images M used in conferences in “June” are placed intoa folder by the operator. As shown in FIG. 8, a “June” folder is createdas a new folder.

After the “June” folder is created, as shown in FIG. 9, the tablecreating unit 323 adds “June” to the table TA that associates foldernames with the UIDs of medical data. The table TA with additional “June”is stored in the storage 34.

Subsequently, in step S3, the simplified images M used in conferences inJune are placed into the “June” folder of the folder browser window FBW.It is assumed that the operator will also place CT images used inconferences in February into the “June” folder. If the operator confirmsthe simplified images M used in conferences in February before placingdesired simplified images M into the “June” folder, as shown in FIG. 10,the operator clicks on a folder icon FI with the cursor CU to display asecond sub window SW2. The second sub window SW2 overlies the list X.The simplified images M in the “conference-2012-February” folder aredisplayed in the second sub window SW2. This allows the operator toeasily confirm the simplified images M used in conferences in February.The second sub window SW2 is a window containing the simplified images Min the same folder and serves as an exemplary embodiment of a secondwindow in the present invention. Moreover, the simplified images Mplaced in the same folder and displayed in the second sub window SW2serve as an exemplary embodiment of an image associated from a differentpoint of view from metadata in a list of Images.

Images based on the original medical data of the simplified images M maybe displayed by clicking the simplified images M in the second subwindow SW2.

The second sub window SW2 displays the folder name“conference-2012-February” of the folder containing the simplifiedimages M used in conferences in February. Thus, the operator can easilyrecognize that the second sub window SW2 shows the contents of the“conference-2012-February” folder.

The second sub window SW2 is a rectangle displayed on the list X withits length extending in a horizontal direction (row direction).Specifically, the second sub window SW2 is a horizontally orientedrectangle, that is, the second sub window SW2 is shaped in one direction(horizontal direction). The simplified images M are horizontallyoriented in the second sub window SW2.

The display of the second sub window SW2 will be discussed below. Thesimplified images M categorized in the folders have the folder icons FI.A click on the folder icon FI displays the second sub window SW2. Thus,the folder icons FI are displayed for the simplified images M displayedin the second sub window SW2. The folder icon FI is an indicator of thefolder containing medical data on the simplified images M displayed withthe folder icons FI. In other words, the folder icon FI is an indicatorthat can distinguish the simplified images based on medical datacontained in the folder from the simplified images M not contained inthe folder, among the simplified images M of the list X. The folder iconFI is an exemplary embodiment of an indicator and a second indicator inthe present invention.

In step S13, the folder icon FI is added in the creation of data in thelist X. Specifically, the display data creating unit 22 adds the foldericon FI to the corresponding simplified image M with reference to a UIDcontained in the table TA. In this case, in step S14, data on the list Xwith the folder icons FI is outputted to the display terminal 3.

When the folder icon FI is clicked, the display screen 31 a displays thesecond sub window SW2 containing the simplified images M of data in thefolder corresponding to the folder icon FI. For example, in FIG. 10, thefolder icon FI displayed on the simplified image M of a CT image on Jan.16, 2012 is clicked by the cursor CD. Data on the CT image on Jan. 16,2012 is placed in the “February” folder. The second sub window SW2allows the operator to confirm that a CT image used in a conference ofFebruary is an image on Jan. 16, 2012.

The folder icon FI and the simplified image are linked with folderspecific information for specifying a folder (folder name). When thefolder icon FI is clicked, the requesting unit 321 outputs the folderspecific information to the server 2. The display data creating unit 22of the server 2 creates data on the second sub window SW2 with referenceto the folder specific information inputted from the display terminal 3.Specifically, the display data creating unit 22 specifies the UIDs ofthe simplified images M in the folder specified by the folder specificinformation, with reference to the table TA. The display data creatingunit 22 then creates data on the second sub window SW2 containing thesimplified images M. The data on the second sub window SW2 is outputtedto the display terminal 3 by the data output unit 23. The displaycontroller 322 displays the list X containing the second sub window SW2,based on data inputted from the server 2.

The operator confirms the simplified images M used in a conference inFebruary, and then places the simplified images M used in a conferencein June into the “June” folder along with the simplified images M of CTimages used in the conference in February. Specifically, as shown inFIG. 11, the operator first displays the first sub window SWI byclicking a numeric icon NI displayed on the cell CEo The first subwindow SWI overlies the list X. The first sub window SWI is an exemplaryembodiment of a first window in the present invention.

The numeric icon NI indicates the number of simplified images M in thecell CE having the numeric icon NI. If the single cell CE containsmultiple simplified images M, only one of the simplified images M isdisplayed. The simplified images M share two types of associatedinformation (in this case, a document type and a date) in the displaycolumns C1 and C2 of the associated information in the list X. In thecell CE containing only one of the simplified images M, the numeric iconNI is not displayed.

In step S13, the numeric icon NI is added when data on the list X iscreated. Specifically, the display data creating unit 22 adds thenumeric icon NI based on the number of specified images M created forthe cell CEo In step S14, data on the list X with the numeric icon NI isoutputted to the display terminal 3. The numeric icon NI is an exemplaryembodiment of a first indicator in the present invention.

The first sub window SWI displays the simplified images M in the singlecell CE. When the numeric icon NI is clicked, the display data creatingunit 22 of the server 2 creates data on the first sub window SWIcontaining the simplified images M having two types of associatedinformation in the cell CE with the displayed numeric icon NI. The dataon the first sub window SWI is outputted to the display terminal 3 bythe data output unit 23, and then the display controller 322 displaysthe first sub window SW1.

In FIG. 11, since the numeric icon NI on the cell CE showing thesimplified image M of a CT image on May 18, 2012 is clicked, thesimplified image M of the CT image on May 18, 2012 is being displayed inthe first sub window SW1. Thus, the first sub window SW1 displays thesimplified images M that share types of associated information in theassociated information display columns C1 and C2. The numeric icon NI isdisplayed for the simplified image M that is displayed in the first subwindow SW1.

The first sub window SW1 is a rectangle displayed on the list X with itslength extending in a vertical direction (column direction).Specifically, the first sub window SW1 is a vertically orientedrectangle, that is, the first sub window SW1 is shaped in one direction(vertical direction). The simplified images M are vertically oriented inthe first sub window SW1. Thus, the first sub window SW1 and the secondsub window SW2 are displayed in different directions and differentdisplay modes.

As shown in FIG. 12, the simplified image M to be placed into the “Junefolder” is dragged and dropped into the “June” folder of the folderbrowser window FBW by the operator. In this case, the simplified image Mof a CT image on Jan. 16, 2012, a CT image on May 18, 2012, a CT report,and the simplified image M of a blood test are dragged and dropped intothe “June” folder with the input unit 33. The simplified images Mdragged and dropped into the folder are associated from a differentpoint of view from metadata. The dragging and dropping of the simplifiedimages M into the folder is an example of input for associating theimages from a different point of view from metadata.

In the present embodiment, an image not displayed on the list X isplaced into the “June” folder as the simplified image M of the CT imageon Jan. 16, 2012. The operator selects desired one of the simplifiedimages M displayed on the first sub window SW1 and then drags and dropsthe image into the “June” folder.

As described above, the operator can easily place desired one of thesimplified images M into the folder only by dragging and dropping theimage into the folder browser window FBW displayed on the list X.

Furthermore, the simplified image M of an image used in a conference inFebruary can be confirmed on the first sub window SWI while thesimplified image M to be placed into the “June” folder is displayed onthe first sub window SWI. Since the first sub window SW1 and the secondsub window SW2 are simultaneously displayed in different directions, thewindows can be easily distinguished from each other.

Dragging and dropping of the simplified image M into the folder allowsthe table creating unit 323 to create a table for associating a foldername with the UID of medical data. The table creating unit 323 writes,as shown in FIG. 13, the UID of medical data on the simplified image Min the “June” folder into CUID of the UID field in the “June” folder ofthe table TA. This completes the table TA (constructs a hierarchicalstructure) for associating the “June” folder with the UID of medicaldata on the simplified image M in the “June” folder. The table TA isstored in the storage 34. The table TA is outputted to the server 2, andthen the table TA for the patient P in the storage 21 is updated.

When a UID is written into CUID of the UID field of the table TA, dataon the simplified image M is placed into the folder.

In this way, the preparation of a conference is completed. The displayscreen 31 a displays a part of data on the list X created by the displaydata creating unit 22. An input on the input unit 33 allows the operatorto move a part to be displayed on the display screen 31 a from the listX created by the display data creating unit 22. In other words, theoperator can move the list X displayed on the display screen 31 a. Asshown in FIG. 14, the operator can move a displayed part of the list Xby dragging the cursor CU on the list X. The dragging operation can movea displayed part of the list X in vertical, horizontal, and diagonaldirections.

When an input (dragging) on the input unit 33 by the operator moves thelist X, as shown in FIG. 15, the display controller 322 hides the firstsub window SWI and the second sub window SW2. Specifically, a press on abutton of the mouse of the input unit 33 hides the first sub window SWIand the second sub window SW2.

The first sub window SW1 and the second sub window SW2 may be hidden byclicking on the cursor CU on the list X.

For example, if the operator needs to view the simplified image Moverlying the first sub window SW1 and the second sub window SW2 or movethe list X to display the simplified image M hidden on the displayscreen 31 a, the operator needs to hide the first sub window SW1 and thesecond sub window SW2. If the first sub window SWI and the second subwindow SW2 interfere with an operator's view or the operator does notneed to display the windows, an input such as dragging and clicking onthe list by the operator hides the first sub window SW1 and the secondsub window SW2, achieving a simple operation.

As shown in FIG. 16, the simplified image M in the “June” folder hasanother folder icon FI. As shown in FIG. 17, the operator places thecursor CU to click on the folder icon FI displayed on the simplifiedimage M (in FIG. 17, the simplified image M of a CT image on May 18,2012) in the “June” folder. As shown in FIG. 18, this can display thesecond sub window SW2 containing the simplified images M placed in the“June” folder. The second sub window SW2 containing the simplifiedimages M placed in the “June” folder is displayed instead of the secondsub window SW2 containing the simplified images M placed in the“February” folder.

As shown in FIG. 19, the first sub window SWI containing the simplifiedimages M of CT images on May 18, 2012 is displayed. In this state, asshown in FIG. 12, a click on the numeric icon NI displayed in the cellCE of a CT report on May 18, 2012 allows the first sub window SWIcontaining the simplified images M of a CT report to replace the firstsub window SWI containing the simplified images M of CT images.

The operator opens the “June” folder in a conference in June anddisplays images based on the simplified images M in the “June” folder toexplain a case of a disease. In order to open the “June” folder, asshown in FIG. 21, the operator enters an input with the input unit 33 todisplay the folder viewer FV on the display screen 31 a. The folderviewer FV includes a folder display field FC and a display field MC forthe simplified images M.

The display of the folder viewer FV will be discussed below. When theoperator enters an input to the input unit 33 to display the folderviewer FV, the data requesting unit 321 requests data on the folderviewer FV from the server 2. The display data creating unit 22 createsdata on the folder viewer FV containing the simplified images M placedin the folder with reference to the table TA stored in the storage 21.The display data creating unit 22 creates data on the simplified imagesM contained in the folder viewer FV, based on medical data having UIDsin the table TA.

Moreover, the display data creating unit 22 creates data on the folderviewer FV containing the simplified images M classified patient. Thedisplay data creating unit 22 specifies patient names or patient IDsbased on metadata with UIDs contained in the table TA, and classifiesthe simplified images M by patient. In FIG. 21, the simplified images Mof patients P, Q, and R are classified and displayed on the displayfield MC of the simplified Images.

The operator selects the “June” folder of the folder display field FC todisplay the simplified images M in the “June” folder on the displayfield MC of the simplified images. The operator then clicks on thesimplified image M displayed in the display field MC of the simplifiedimages. This causes the display screen 31 a to display the images(original images), which is not particularly shown, based on medicaldata (the original data of the clicked simplified image M) stored in thestorage 21 of the server 2. Thus, a case of a disease can be explained.During the explanation, the operator can compare a CT image used in aconference in February and a CT image newly obtained on May 18, 2012.

A click on the simplified image M outputs the UID of the simplifiedimage M to the server 2. The data output unit 23 of the server 2 outputsmedical data to the display terminal 3 according to the UID inputtedfrom the display terminal 3. This allows an original image based on themedical data to be displayed on the display 31.

The present invention was described according to the embodiment. As amatter of course, the present invention can be modified in various wayswithin the scope of the present invention. For example, only the lengthsof the first sub window SW1 and the second sub window SW2 need to extendin different directions (orientations). In other words, the orientationsof the simplified images M in the first sub window SW1 only need to bedifferent from those of the simplified images M in the second sub windowSW2. For example, in the present embodiment, the first sub window SW1 isa vertically oriented rectangle while the second sub window SW2 is ahorizontally oriented rectangle. Conversely, the first sub window SW1may be a horizontally oriented rectangle while the second sub window SW2may be a vertically oriented rectangle. In this case, the simplifiedimages M are horizontally disposed in the horizontally oriented firstsub window SW1 while the simplified images M are vertically disposed inthe vertically oriented second sub window SW2. The lengths of the firstsub window SW1 and the second sub window SW2 may be diagonally extendedas long as the lengths are not in parallel with each other.

The first sub window SW1 and the second sub window SW2 may vary in shapeand color.

In the present embodiment, the list of simplified images is displayedbased on medical data. The present invention is not limited to medicaldata. The present invention is applicable to a display device thatdisplays a list of images based on data containing associatedinformation of multiple attributes as metadata, and an image displaysystem. In the list, however, the simplified images need to be locatedfor associated information of one attribute in the column direction andfor associated information of another attribute in the row direction.

As shown in FIG. 22, the table creating unit 323 provided in the displayterminal 3 may be replaced with a table creating unit 24 in the server2. In this case, dragging and dropping of the simplified image M intothe folder outputs the UID of the simplified image M to the server 2 andthen is written into CUID of the UID field of the table TA.

What is claimed is:
 1. A computer-implemented method for visuallyrepresenting electronically-stored and interrelated files in aglanceable manner, comprising: displaying a plurality of thumbnails in amatrix format, wherein a thumbnail represents an electronically-storedfile, wherein a set of rows of the matrix format contains thumbnails ofelectronically-stored files that share a first characteristic, andwherein a set of columns of the matrix format contains thumbnails ofelectronically-stored files that share a second characteristic;displaying a first window over the matrix format, wherein the firstwindow corresponds to a selected thumbnail in the matrix format andcontains other thumbnails of electronically-stored files that share boththe first and second characteristics with the electronically-stored filerepresented by the selected thumbnail; and displaying a second windowover the matrix format, wherein the second window corresponds to theselected thumbnail and contains other thumbnails ofelectronically-stored files that are in a same electronic folder as theelectronically-stored file represented by the selected thumbnail.
 2. Thecomputer-implemented method of claim 1, wherein the displaying thesecond window occurs during display of the first window.
 3. Thecomputer-implemented method of claim 1, wherein the first window and thesecond window are displayed in different orientations.
 4. Thecomputer-implemented method of claim 3, wherein the differentorientations include a horizontal orientation, in which a window'shorizontal width exceeds its vertical height, and a verticalorientation, in which a window's vertical height exceeds its horizontalwidth.
 5. The computer-implemented method of claim 1, wherein theselected thumbnail bears a first indicator that indicates a set ofelectronically-stored files that share both the first and secondcharacteristics with the electronically-stored file represented by theselected thumbnail.
 6. The computer-implemented method of claim 5,wherein the displaying the first window occurs in response to a userselecting the first indicator.
 7. The computer-implemented method ofclaim 1, wherein the selected thumbnail bears a second indicator thatindicates the electronic folder in which the electronically-stored filerepresented by the selected thumbnail is stored.
 8. Thecomputer-implemented method of claim 7, wherein the displaying thesecond window occurs in response to a user selecting the secondindicator.
 9. A display device for visually representingelectronically-stored and interrelated files in a glanceable manner,comprising a processor and a computer-readable memory havingcomputer-executable instructions thereon, wherein execution of thecomputer-executable instructions by the processor causes the processorto: display a plurality of thumbnails in a matrix format, wherein athumbnail represents an electronically-stored file, wherein a set ofrows of the matrix format contains thumbnails of electronically-storedfiles that share a first characteristic, and wherein a set of columns ofthe matrix format contains thumbnails of electronically-stored filesthat share a second characteristic; display a first window over thematrix format, wherein the first window corresponds to a selectedthumbnail in the matrix format and contains other thumbnails ofelectronically-stored files that share both the first and secondcharacteristics with the electronically-stored file represented by theselected thumbnail; and display a second window over the matrix format,wherein the second window corresponds to the selected thumbnail andcontains other thumbnails of electronically-stored files that are in asame electronic folder as the electronically-stored file represented bythe selected thumbnail.
 10. The display device of claim 9, wherein theprocessor displays the second window while displaying the first window.11. The display device of claim 9, wherein the first window and thesecond window are displayed in different orientations.
 12. The displaydevice of claim 11, wherein the different orientations include ahorizontal orientation, in which a window's horizontal width exceeds itsvertical height, and a vertical orientation, in which a window'svertical height exceeds its horizontal width.
 13. The display device ofclaim 9, wherein the selected thumbnail bears a first indicator thatindicates a set of electronically-stored files that share both the firstand second characteristics with the electronically-stored filerepresented by the selected thumbnail.
 14. The display device of claim13, wherein the processor displays the first window in response to auser selecting the first indicator.
 15. The display device of claim 9,wherein the selected thumbnail bears a second indicator that indicatesthe electronic folder in which the electronically-stored filerepresented by the selected thumbnail is stored.
 16. The display deviceof claim 15, wherein the processor displays the second window inresponse to a user selecting the second indicator.
 17. Acomputer-program product for visually representing electronically-storedand interrelated files in a glanceable manner, the computer programproduct comprising a non-transitory computer readable storage mediumhaving program instructions embodied therewith, the program instructionsexecutable by a processing component to cause the processing componentto: display a plurality of thumbnails in a matrix format, wherein athumbnail represents an electronically-stored file, wherein a set ofrows of the matrix format contains thumbnails of electronically-storedfiles that share a first characteristic, and wherein a set of columns ofthe matrix format contains thumbnails of electronically-stored filesthat share a second characteristic; display a first window over thematrix format, wherein the first window corresponds to a selectedthumbnail in the matrix format and contains other thumbnails ofelectronically-stored files that share both the first and secondcharacteristics with the electronically-stored file represented by theselected thumbnail; and display a second window over the matrix format,wherein the second window corresponds to the selected thumbnail andcontains other thumbnails of electronically-stored files that are in asame electronic folder as the electronically-stored file represented bythe selected thumbnail.
 18. The computer program product of claim 17,wherein the processing component displays the second window whiledisplaying the first window.
 19. The computer program product of claim17, wherein the first window and the second window are displayed indifferent orientations.
 20. The computer program product of claim 19,wherein the different orientations include a horizontal orientation, inwhich a window's horizontal width exceeds its vertical height, and avertical orientation, in which a window's vertical height exceeds itshorizontal width.